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1.  Introduction 

A  model  used  frequently  for  time  series  ancilysis  is  a  stationary  stochastic  process. 
If  the  process  is  Gaussian,  it  is  completely  determined  by  the  mean  of  the  process  (a 
location  parameter),  the  variance  of  the  process  (a  scale  parameter),  and  the  sequence 
of  autocorrelations  (also  known  as  lag  correlations  and  as  serial  correlations).  The 
analysis  of  times  series  differs  from  many  other  statistical  analyses  because  of  the 
possible  dependence  among  observations;  that  dependence  may  be  characterized  by 
the  autocorrelation  sequence.  For  any  time  series  analysis  it  is  essential  to  make 
inferences  about  the  autocorrelations. 

The  Fourier  transform  of  the  autocorrelation  sequence  provides  an  alternative 
view  of  the  pattern  of  dependence.  For  many  purposes  it  may  be  more  enlighten¬ 
ing.  In  this  paper  we  consider  the  standardized  spectral  distribution  function  as  an 
appropriate  description  ,  of  the  pattern  of  dependence  and  study  problems  of  infer¬ 
ence  concerning  it.  “Standardized”  means  that  the  spectral  distribution  is  defined  in 
terms  of  correlations,  rather  than  covariances.  The  same  information  is  contained  in 
the  autocorrelation  sequence,  the  standardized  spectral  density,  and  the  standardized 
spectral  distribution,  but  the  three  forms  differ  in  presentation. 

The  first  inference  problem  treated  here  is  the  testing  of  a  null  hypothesis  that 
completely  specifies  the  pattern  of  dependence;  for  example,  the  null  hypothesis  might 
be  that  all  of  the  autocorrelations  aire  zero  or  equivalently  that  the  spectral  density  is 
constant.  To  test  this  hypothesis  we  compare  the  sample  standardized  spectral  dis¬ 
tribution  with  the  process  standardized  spectral  distribution  by  means  of  a  goodness 
of  fit  criterion,  such  as  the  Cramer-von  Mises  criterion  and  the  Kolmogorov-Smirnov 
criterion.  Asymptotic  and  other  approximate  distributions  are  obtained.  The  mathe¬ 
matics  is  similar  to  that  of  goodness  of  fit  tests  of  probability  distributions,  but  differs 


in  an  essential  way.  A  goodness  of  fit  test  usually  is  consistent  against  all  dternatives, 
in  this  case  against  all  correlation  structures  different  from  the  null  hypothesis. 

The  Kolmogorov-Smimov  criterion  can  be  inverted  to  give  a  confidence  region  for 
an  unspecified  standardized  spectral  distribution.  Such  a  confidence  region  can  be 
used  to  infer  the  increatse  in  the  distribution  over  various  intervals  of  frequency. 

Grenander  and  Rosenblatt  (1952), (1957)  studied  the  asymptotic  distribution  of 
the  differences  between  the  conventional  sample  spectral  distribution  function  2md 
the  conventional  process  spectral  distribution  function.  They  argued  that  as  a  pro¬ 
cess  it  converges  to  Brownian  motion  with  a  transformed  time  par2imeter  under  the 
condition  that  the  eighth-order  moments  of  the  innovations  in  the  stationary  linear 
process  are  finite.  They  proved  that  the  Kolmogorov-Smirnov  criterion  for  the  con¬ 
ventional  spectral  distribution  converges  in  distribution  to  the  supremurn  of  the  limit 
process.  This  unstandardized  spectral  distribution,  however,  is  not  suited  to  questions 
of  dependence  (that  is,  patterns  of  correlation),  and  the  limiting  distributions  depend 
on  fourth-order  cumulants.  MacNeil  (1971), (1975)  considered  further  goodness  of  fit 
tests  based  on  these  imstandardized  spectral  distributions. 

Bartlett  (1954), (1966)  proposed  the  sample  standardized  spectral  distribution  for 
testing  hjrpotheses  about  correlations  and  asserted  that  the  asymptotic  distribution 
would  not  depend  on  fourth-order  cumulants,  but  he  did  not  find  any  of  these  distri¬ 
butions.  Bartlett  treated  in  more  det2dl  an  analogue,  namely,  the  integral  (or  sum) 
of  the  sample  spectral  density  (periodogram)  divided  by  the  hypothetical  process 
spectral  density.  This  definition  leads  to  the  Brownian  bridge,  and  the  maximum  of 
the  difference  between  this  function  of  the  frequency  eind  the  frequency  (over  [0,7r]) 
has  the  asymptotic  distribution  of  the  Kolmogorov-Smirnov  statistic  for  goodness 
of  fit  of  probability  distributions.  Priestley  (1981),  Section  6.2.6,  summarizes  these 
developments.  See  also  Dzhaparidze  and  Osidze  (1980). 

Dahlhaus  (1985a)  showed  that  the  difference  between  the  sample  and  process 
standardized  spectral  distributions  multiplied  by  the  square  root  of  the  sample  size 
converges  weakly  to  a  Gaussian  process  under  several  alternative  conditions,  but 
always  assuming  finite  eighth-order  moments.  He  obtsuned  the  covariance  function, 
but  expressed  it  differently  from  the  form  used  in  this  paper.  He  showed  that  the 
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supremum  of  the  absolute  value  of  the  limiting  process  does  not  have  the  Kolmogorov- 
Smimov  distribution  in  general  and  expressed  the  probability  in  terms  of  a  boundary 
crossing  probability  involving  the  Brownian  motion  process.  Dahlhaus  (1988)  gave  a 
brief  formal  treatment  of  the  problem  with  estimated  parameters. 

The  thrust  of  this  paper  is  to  develop  the  treatment  of  tests  of  goodness  ot  tit 
and  confidence  regions  based  on  the  knowledge  of  the  limiting  Gaussian  distribution 
to  actual  applications.  This  study  includes  methods  of  computing  the  goodness  of  fit 
statistics,  finding  their  limiting  distributions,  providing  probability  inequalities,  and 
developing  asymptotic  confidence  regions.  As  noted  above,  in  general  the  proems 
with  transformed  time  parameter  is  different  from  the  Brownian  bridge.  The  limiting 
distributions  are  valid  under  weak  conditions,  not  requiring  fourth-order  moments  or 
stationarity. 

2.  The  Empirical  Process 

Consider  a  stationary  stochastic  process  {y<} ,  t  =  •  •  • ,  —  1, 0, 1,  •  •  • ,  with  Syt  = 
0,  autocovariance  function 

(2.1)  ^ytVt+k  =  ^  =  •••,-l,0,l,”-, 

and  autocorrelation  function 

(2.2)  PH  =  <r{h)/<T{0),  /»  =  •-•, -1,0,1,--.. 

We  define  the  normalized  spectral  density  as 

(2.3)  /(A)  =  ^  Pfc  cos  Aft,  -TT  <  A  <  TT. 

fc=-oo 

Note  that  the  coefficients  of  the  trigonometric  functions  are  the  autocorrelations,  not 
the  autocovariances.  The  Fourier  transform  of  the  standardized  spectral  density  is 

(2.4)  pg  =  J  ^f{X)cosXgdX,  ^  =  •  •  • , -1,0, 1,  •  ■  ■ . 

Knowledge  of  the  standardized  spectral  density  is  equivalent  to  knowledge  of  the 
autocorrelations.  The  pattern  of  correlation  can  be  described  equivaJently  in  terms 
of  the  autocorrelations  or  the  standardized  spectral  density. 
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Since  /(A)  =  /(—A),  we  define  the  standardized  spectral  distribution  as 

(2.5)  F{X)  =  2rf{u)dv 

Jo 

1  sinAhA 

~  ^  \  ^  ^  )  ' 

Note  that  F{t)  =  1;  the  standairdized  spectral  distribution  has  the  properties  (non¬ 
negative  increments)  of  a  probability  distribution  on  [0,t].  In  this  paper  we  shall  be 
concerned  with  inference  about  the  standardized  spectral  density  or  distribution. 

Inference  is  based  on  a  sample  ,yr-  We  define  the  sample  autocovariance 
sequence 

(2.6) 


j  T-k 

c/i  =  c_fc  =  —  53  yttft+h,  h  =  0, 1,  •  •  •  . 


1=1 


The  sample  autocovariance  is  a  biased  estimator  of  the  process  autocovariance  {h  > 
0),  but  it  is  asymptotically  unbiased.  We  define  the  sample  autocorrelation  sequence 


(2.7) 


r^  =  r_fc  =  — ,  h  =  0yl, 

Co 


the  st2uidardized  sample  spectral  density  (popularly  mislabelled  as  the  periodogram) 

1 


(2.8) 


/r(A)  = 


2jrco 
2x 


t=l 
T-l 


=  —  51  r^^  cos  Xh,  — TT  <  A  <  TT, 

""  fc=-(r-i) 

and  the  stand2U'dized  sample  spectral  distribution  function 

rA 


(2.9) 


^r(A)  =  2  /  dv 

Jo 


=  H 


^  ^  sin  Xh 


A  -I-  2  53  Tfc 


h=l 


y 


We  shall  study  inference  based  on  vT[A’(A)  —  ^(A)],  0  <  A  <  ;r;  the  limiting 

distribution  will  be  obtained  as  T  — »  oo. 

Because  patterns  of  dependence  can  be  described  in  terms  of  the  autocorrelations, 
the  standardized  spectrsd  density  and  distribution  are  relevant  to  questions  of  depen¬ 
dence,  rather  than  the  usual  functions  defined  in  terms  of  autocovariances;  the  scale 
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parameter  of  the  process  is  irrelevant.  An  additional  advantage  of  the  standardiza¬ 
tion  is  that  the  asymptotic  distributions  axe  valid  under  much  more  general  conditions 
than  without  the  standardization,  but  general  conditions  will  be  stated  later  in  the 
paper.  Another  advantage  is  that  F{X)  and  Ft{X)  have  properties  of  theoretical  and 
empirical  probability  distribution  functions,  respectively. 

The  asymptotic  theory  is  developed  for  linear  processes 

(2-10)  =  <  =  •••,-!, 0,1,---, 

f=0 

where  SufU,  =  0,  t  ^  s.  In  particular,  if 

the  ut’s  are  independently  identically  distributed, 

(2.11)  £|7.|<oo, 

<=o 

and 

(2.12)  Y, 

•sO 

then  for  any  integer  H 

(2.13)  [v^(rj  -  pi), . .  ■ ,  y/Tir„  -  p„)]  4  NiO,  W), 


where  the  {g,  h)  element  of  W  is 
00 

(2.14)  WgH  =  53  {Pr+aPr+h  +  Pr-gPr+h  “  2pHprpT^g  “  2pgPrPr+h  +  2pgPHpl). 

oo 


Note  that 

00 

(2.15) 

<r{h)  = 

^  ^  ^  'It'lt+hy  h  —  0,  1,  •  •  •  , 

*=0 

(2.16) 

Ph  = 

L  n  1 

Y'oo  ^2  ’  “  —  Ij  ■  ■  ■  > 

2^t=0  7* 

and 

1  00  2 

=  2,5--  E7,e'‘-  . 

7»  ,=o 

(2.17) 

m 

In  a  sense  the  7’s  are  the  Fourier  coefficients  of  the  square  root  of  /(A).  [If  yt  is  defined 
by  (2.10),  {pa},/(A),  and  F{X)  are  defined  even  if  the  process  is  not  stationarv] 
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The  limiting  distribution  (2.13)  was  given  by  Bartlett  (1946)  under  the  (implicit) 
assumption  that  Exit  <  oo.  That  the  limiting  distribution  is  valid  under  the  assump¬ 
tion  of  only  Eu]  <  oo  was  shown  by  Anderson  (1959)  for  autoregressive  processes 
and  by  Anderson  and  Walker  (1964)  for  yt  =  I2^_oo  and  |s|7^  <  oo. 

Hcinnan  and  Heyde  (1972)  relaxed  the  condition  on  {7,}  to  13^  <  00  when  the 

sum  was  over  0, 1, 2, . . .  and  the  condition  of  iid  Ut  to  martingale  differences.  Anderson 
(1991)  has  frirther  relaxed  the  conditions  on  the  martingle  differences. 

Consider 

(2.18)  Vf[Fr(A)  -  F(A)1  =  -  -  f; 

^  h=l  ^  ^  h=T  ^ 

We  treat  \/T[Ft{\)  —  i^(A)]  as  a  stochastic  process  on  [0,  tt]  As  T  — »  00,  this  process 
converges  weakly  to  a  Gaussian  process  with  covariance  function 

(2.19)  4ir{G[min(A,i/)l  - 


where 

(2.20) 

The  proof  of  this  statement  is  given  in  the  appendix.  The  first  term  in  (2.19)  was 
given  by  Grenander  and  Rx>senblatt  (1957).  Durlauf  (1989)  derived  the  special  case 
of  (2.19)  when  /(A)  =  l/(27r).  Dadilhaus  (1985)  gave  the  first  form  of  the  covariance 
function. 

We  can  simplify  the  covariance  of  function  of  the  process  by  making  the  monotonic 
transformation 

(2.21)  u  =  0  <  A  <  », 

to  0  <  u  <  1.  The  inverse  transformation  (defined  properly  if  /(A)  >  0,  0  <  A  <  x] 
is 

(2.22)  A  =  G-^[G(7r)u],  0  <  u  <  1. 


G(A)F(t/)  -  F(A)G(i/)  +  G{i:)F{X)F{u)} 

GiX)  =  2j^  f{u)dv. 
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Now  let 

(2.23)  Yt{u)  =  y/f  -  F{G-MG(«-)u]})  . 

The  covariance  function  of  the  limiting  distribution  of  Yt{u)  is 

(2.24)  4T(jr(ir){min(u,t;)  —  uv  +  9(“)9(w)}» 
where 

(2.25)  q{u)  =  u  -  F{G-^[G(?r)u]}. 

Note  that  ^(0)  =  ^(1)  =  0.  It  is  of  interest  that 


(2.26) 

is  equivalent  to 
(2.27) 


q{u)  =  0,  0  <  «  <  1, 


-  F(A)  =  2  [ 
Jo 


Pi^) 


G{ir) 

which  in  turn  is  equivalent  to 
(2.28)  /(^)[£4-l 

In  particular,  ^(u)  =  0  for 


-m 


du  =  Q,  0  <  A  <  1, 


LG(x) 


=  0 


a.  e. 


(2.29) 


or 


Pi  =  P7  =  •  ‘ =  0. 


Durlauf  (1989)  has  studied  tests  of  lack  of  correlation. 
Let  B{u)  be  the  Brownian  bridge;  that  is,  SB{u)  =  0, 


(2.30) 


EB{u)B{v)  =  min(u,v)  —  ttu. 


B{u)  is  Gaussian,  and  sample  paths  are  continuous  with  probability  1.  Then 

(2.31)  L  YtM^B(u)  +  q{u)X, 

where  X  has  the  standard  normal  distribution  iV(0, 1),  and  the  covariance  matrix  of 
B{u)  +  9(u)A'  is 

(2.32)  A:(u,  r)  =  min(u,  u)  —  «v  +  q{y.)q{v). 
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This  covauriance  function  is  larger  than  the  covariance  function  of  B{u),  min(u,  v)—uv, 
in  the  Loewner  sense;  that  is, 

(2.33)  /  /  k(u,v)l(u)l(v)  du  dv  >  f  f  [min(u,t;)  —  tit;]/(«)/(u)  du  (ft; 

Jo  Jo  Jo  Jo 

for  any  /(•)  for  which  the  integrals  are  defined.  Thus 

(2.34)  Pr{B(«)  +  Y9(«)  €  C}  <  Pr{B(ti)  €  C} 
for  any  convex  symmetric  C  [Anderson  (1955)]. 


3.  Test  of  a  Specific  Hypothesis 

3.1.  Test  Criteria 

Consider  testing  the  null  hypothesis 


(3.1)  : /(A)  - /o(A), 

where  /o(A)  is  completely  specified.  Among  the  criteria  available  to  test  this  hypoth¬ 
esis  axe  the  Cramer-von  Mises  criterion 


the  Kolmogorov-Smimov  criterion 


(■’.3) 


sup  |yx(u)|  =  sup 


VT 


and  the  Anderson-Darling  statistic 


0<A<ir  2yJ'KG{v) 


|Ft(A)  -  Fo(A)|, 


where  0(u)  =  l/[u(l  —  u)].  If  the  null  hypothesis  is  /o(A)  =  l/(2fl')  ,  that  is,  com¬ 
plete  lack  of  correlation,  the  asymptotic  tests  are  exactly  those  of  goodness  of  fit  of 
probability  distributions.  See,  for  example,  Shorack  and  Wellner  (1986)  for  »  ’•eview 
of  such  tests. 
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To  carry  out  a  test  procedure,  we  would  like  to  know  the  limiting  distribution  of 
the  criterion  under  the  null  hypothesis.  This  is  the  distribution  of  the  functional  when 
the  limiting  distribution  of  Yt{u)  is  Gaussian  with  covariance  function  (2.23).  Under 
the  null  hypothesis  ^(u)  is  specified.  The  justification  is  the  continuous  mapping 
theorem  [Theorem  5.1,  Billingsley  (1968),  for  example). 

3.2.  The  Cramer-von  Mises  Criterion 

The  Brownian  bridge  has  the  covariance  function 

OO  J 

(3.5)  tmn(u,v)-uv  = 

j=i 

where 

(3.6)  /j(u)  =  \/28in  jxu 

and  Xj  =  These  eigenvalues  and  eigenfunctions  satisfy  the  integral  equation 

(3.7)  f{u)  =  X  f  [min(«v)  —  uv]f{v)dv 

Jo 

with  boimdary  conditions  /(O)  =  /(I)  =  0.  The  eigenfunctions  are  normalized  by 
/o  P{'u)du  =  1:  they  are  orthogonal  in  th#*  sense  that  Jq  fi{u)fj{u)du  =  0,  i  ^  j.  The 
process  has  the  representation. 

(3.8)  B(u)  i  f,  -LxMu), 

j=i 

where  Xi, Xj,  ■  •  •  are  independent  N{0, 1)  variables.  The  integral  can  be  represented 
as 


(3.9)  f^B\u)du  = 


OC  J 
1=1 
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The  ch2u:acteristic  function  of  (3.9)  is 


(3.10) 

/  sin  n/2zI  \  * 

\  \/2i7  j 

The  function  D{X)  =  n^i(l  ~  X/Xj)  =  sins/Xf y/X  is  known  as  the  Fredholm  deter¬ 
minant  of  the  integral  equation  (3.7). 

Let 


(3.11)  Oj  =  /  q{u)fj{u)du 

Jo 


2s/2 


r 

Jo 


G(r)  Jo 

for  q{u)  square-integrable.  Then 


sm  hr 


G{X) 


G(t)J  iG(x) 


G(A) 


-F{X) 


f{X)dX 


(3.12)  ?(«)  =  EQrj/>(«). 

j=l 

The  process  B{u)  -1-  Xq{u)  has  the  representation 


(3.13) 


B{u)  -f  Xq{u) 


/>(«)> 


and  the  Cramer-von  Mises  criterion  has  the  representation 


(3.14)  S  =  JjB{u)  +  Xq{u)]'^du 
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where  Yj  =  Xj/y/Xj  +  ajX.  The  (infinite)  covariance  matrix  of  Yj  is 

3 


(3.15) 


0201 

O3O1 


O1O2 

0302 


0103 

0203 

j^  +  03^  ••• 


The  statistic  (3.14)  can  be  approximated  by  a  finite  sum 


(3.16)  Ss  =  't  Y^. 

j=i 

The  difference  between  (3.14)  and  (3.16)  has  expectation 


(3.17) 


jsN+l  i=A^+l 


The  expectation  can  be  made  arbitrarily  small  by  taking  N  sufficiently  large.  Hence, 
as  N  —*  00,  the  distribution  of  Sn  converges  to  the  distribution  of  S  and  the  charac¬ 
teristic  function  of  Ss  approaches  the  characteristic  function  of  S. 

Let  yjv  be  the  7V-vector  with  Yj  as  the  j  —  th  component.  The  covariance  matrix 
of  Yn  is 


(3.18)  EYffYjif  =  An  +  ONCt'ff, 

where  An  is  the  diagonal  matrix  with  1/Xj  as  the  j  —  th  diagoned  element  and  qn  as 
the  vector  with  Oj  as  the  j  —  th  component.  Then  the  characteristic  function  of  Sn 
is 


(3.19) 


E  c 


l/;v  —  2if(A;V  +  aA^a'yv)!  * 

^(l-2i^<^i;v)■^ 


where  4>jN  is  the  j  —  th  chsu'acteristic  root  of  An  +  onoini  j  ~  of 
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(3.20)  \\n  +  OtNOlN  ~  = 


1  0 
— QtiV  Ajv  —  (f>lN  +  OlNOc'ff 

1  a;, 

—ocpi  Af/  — 


=  |Aiv-^/N|{l  +  Q;5v{Ajv-<^/N)  ayv} 


=  |Ayv  —  ^/yv| 


for  <f>  ^  =  1,  •  •  • ,  AT.  We  shall  write 


(3.21)  =  |/jv  -  i'(AAr  + 


H(-ai‘*sA) 


The  first  term  in  D*j^{v)  is 


(3.22) 

as  N  — *  oo.  The  second  term  is 


a('-a-o('-a 


(3.23) 


since 


N  f^2  N  oo  ^2  oo 

1  - E  — "  1  -  - ‘'E«> 

j=i  - »'  ,=i  >=i  >^j-v 


(3.24) 


E  =  /  q^(u)du. 
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Hence,  D'‘j^{v)  converges  to 


(3.25)  = 

The  characteristic  function  of  S  is  l/^Z)*(2it). 

Alternatively  consider  the  covariance  function 

(3.26)  it(u,  u)  =  inin(u,  u)  —  ut;  +  q{u)q(v). 

If  ^(u)  is  continuous,  k{u,  v)  is  continuous  and  has  the  representation 

(3.27)  A:(u,u)  =  £  ^gi{u)gj{v), 

3=1 

where  t/j  and  ^j(v)  satisfy  the  integral  equation 

(3.28)  g{u)  =  u  f  k{u,v)g{v)dv. 

JO 

Since  ^(0,0)  =  k{l,  1)  =  0,  the  functions  jr,(‘)  should  satisfy  the  boundary  conditions 


(3.29) 


g{0)  =  g{l)  =  0. 


If  (3.28)  is  differentiated  twice  with  respect  to  u  and  q{u)  is  twice  differentiable,  we 
obtain 

(3.30)  y'(u)  +  i/g{u)  =  i/Cq'\u), 
where 

(3.31)  ^  -  f 

Jo 

J.  B.  Keller  has  pointed  out  that  the  solution  of  (3.30)  satisfying  (3.29)  and  de¬ 
pending  on  V  is  for  u  ^  =  1, 2,  •  •  • , 


(3.32)  g{u;v)=  —  ^  {sin\/i/(u  —  1)  /  sin  ■yvtq{t)dt 

sin  y/v  K  Jo 

-f  sin  y/uu  j  sin\4'(/  —  l)g(t)df|  -|-  vCq{u). 
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When  we  multiply  (3.32)  by  ?(«),  integrate  from  0  to  1,  and  use  (3.31),  we  obtain 

(3.33)  C  =  Cv^  /  /  c(u,<;  v)q{u)q{t)du  dt  +  Cv  f  q^{u)  du, 

Jo  Jo  Jo 


where 


(3.34) 


c(u,t\v)  - y=—. — 7=sin\/i/usin\/i/(t  —  1),  u  <  t, 

yjv  sm  yjv 


\/t/sin\/j/ 


sin  yjv(y.  —  1)  sin  s/vt^  u>t. 


It  follows  from  (3.33)  that  if  C  ^  0  i/  must  satisfy 

(3.35)  0  =  1  — f  f  c{u,t\v)q{u)q{i)dvdt  — u  j  q^{u)du. 

Jo  Jo  Jo 

If  C  =  0,  then  v  =  for  some  y.  The  function  c(u,  t;  v)  is  the  resolvent  or  resolving 
kernel  of  the  kernel  min(u,  t)  —  ut;  that  is,  it  satisfies 

(3.36)  c(u,  u;  u)  =  min(u,  v)  —  uv-\rv  f  c(u,  <;  i/)[min(t,  v)  —  tv]dt. 

Jo 

See  Goursat  (1964),  for  example. 

Integration  shows  that 

(3.37)  [  [  c{s,t-,v)fi{s)fj{t)dsdt  =  — ,  i  =  j, 

Jo  Jo  Aj  —  V 


=  0,  *  j. 


Hence,  the  resolvent  has  the  representation 


(3.38) 


(3.39) 


[  I  c(s,  <;  v)qis)q{t)d3  dt  =  f^ 

Jo  Jo  Aj  -  V 


Thus  the  right-hand  side  of  (3.25)  is  the  right-hand  side  of  (3.35).  Hence  the  char£ic- 
teristic  function  of  5  is  D^{2it),  where  D*{v)  is  given  by  (3.25)  or  by 

(3.40)  D*{v)  =  L  lo 
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Let  the  zeros  of  D*{v)  be  i/j,  j  =  1, 2,  •  •  • ;  if  Oj  ^  0,  j  =  1, 2,  •  •  • ,  these  zeros  axe 
distinct.  (They  may  be  distinct  even  though  this  condition  is  not  satisfied.)  Then  for 
V  =  Vj  there  is  a  solution  gj{u)  satisfying  (3.28),  the  boundary  conditions  (3.29),  and 
fo  =  1-  The  process  has  the  representation 

(3.41)  B(u)  +  Xq(u)  =  f; 

j=o 

where  Zi,Z2,’--  are  independent  iV(0, 1)  variables,  and  the  integral  has  the  repre¬ 
sentation 

(3.42)  l'{B{u)  +  X,(u)fdu  =  f:^Z]. 

''®  j=i 

When  the  explicit  form  (3.40)  of  the  FVedholm  determinant  is  intractable  or  cannot 
be  inverted,  it  can  be  approximated  by  Dff{u)  given  by  (3.21).  For  this  we  turn  to 
the  numerical  evaluation  of  the  characteristic  roots  of  Ajv  +  ctsotNi  which  we  call 
4in  >  4>2S  >  •  •  •  >  <I>NN-  These  approximate  the  reciprocals  of  the  first  N  eigenvalues 
of  k{uqv).  They  are  the  zeros  of  (3.20).  A  value  1/Xj  is  such  a  zero  if  and  only  if 
Oj  =  0.  Let  1/AJ  >  l/AJ  >  •••  >  l/Xff*  be  the  values  of  l/Xj  that  correspond  to 
Oj  ^  0.  Then  (3.20)  is 

(3.43)  IAa,  -  ^/ivlV'(^), 
where 

^  a-’ 

(3.44)  =  l  + 

1=1  a;-* 

and  Oj  is  the  a*  corresponding  to  1/Ay.  The  first  derivative  of  r/’(^)is 

(3.45)  d’W  =  z  >  o- 

As  <f>  —*  1/Ay  from  above,  V’(^)  —*  — oo»  and  as  ^  1/Ay  from  below,  0(^)  — »  oo. 
Since  V’(^)  is  continuous  except  at  ^  =  1/Ay,  j  =  1,---,A/^*,  there  is  a  root  in  the 
interval  (1/Ay,  1/Ay_j),  j  =  1, •  •  • , A/^*,with 


1/a;  = 


(3.46) 


The  N  zeros  of  (3.43)  can  now  be  numbered  so  that  1/Aj  <  (f>j  <  1/Aj_i, 

Bunch,  Nielsen,  and  Sorenson  (1978)  have  given  a  algorithm  for  solving  the  equa¬ 
tion  V’(^)  =  0-  To  find  the  root  <f>  in  the  interval  (1/Aj,  l/A^.j)  for  j  >  1  define 


(3.47) 


(3.48) 


"■  1  1 

>/’-(<»)  =  Ex^'  T7  <*<■>;-. 

k=i  AJ  ~  ^  ^3  ^3-3 


3-1  ^*2  1  1 

M<f>)  =  E  -T-^,  F  ^  <  F~- 

k=lK~^  ^3  ^3-1 


Then  0_(^)  <  0  and  >  0.  Let  ^  (l/A^  <  <  l/'^j-i)  be  an  initial  value  of 

<f>.  For  i  =  1, 2,  •  •  ■  define  Pi,qi,ri, •s,-  to  satisfy 

-  V»-(^(.-i)),  n  +  , - =  V»+(^(.-i)), 


(3.50) 


(9i  -  9(i-i)) 

Next  define  as  the  solution  to 


°  (1/a;  -  V.,)'  =  '^V(^«-»). 


(3.51) 


Pi  ,  .  _  . 

- 7  —  1  +  Ti  -I-  ryr; - 7 


that  lies  in  the  interval  (1/Aj,  l/AJ_i).  If  ^  c  (1/A*,^^,)  then 


(3.52) 


^(«)  <  ^(«+i)  *  =  1> 2,  •  •  • , 


and  converges  quadratically  to  the  zero  of  V’(^)  that  lies  in  the  interval 

(i/a;,i/a;_,). 

The  cumulants  of  S  are  given  by 

(3.53)  ■ 

t=l  ' 

They  can  also  be  calculated  from  the  kernel  (3.26).  Let  ki{s,t)  =  k{s,t)  and 
A:j+i(s,t)  =  /o  kj{s,u)k{u,t)du.  Then 

(3.54)  Kj  =  -  1)!  kj{s,s)ds. 
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See  Anderson  d  Darling  (1952).  The  expression  (3.53)  is  obtained  from  the  expansion 
of  the  logarithm  of  the  characteristic  function  of  S  in  powers  of  it\  the  coefficient  of 
{ityij\  is  the  j  —  th  cumulant.  kappatly,  it  is  the  coefficient  of  /j\  in  the  expansion 
of  —  |logD*(i/),  given  by  (3.25)  or  (3.40).  We  have  [from  (3.25)] 


(3.55)  -  llogr-(.)  =  -i  n  -  ilog  (l  -g  3^) 

The  second  term  on  the  right-hand  side  of  (3.55)  is 


(3.56) 


The  first  two  cumulants  are 


(3.57) 


OO  1 


(3.58)  Kj  =  Var5 


i=i  \j=i  / 

u)  —  uv]9(u)9(v)dudt;  + 


3.3.  Calculation  of  the  Cramer-von  Mises  criterion 

If  we  omit  (2\/7’/ir)  Ph  sin  Xh/h,  the  Cramer-von  Mises  criterion  (3.2)  can 
be  written  as  7’/[2xG^(x)]  times 


(3.59) 


sin  Xh ,  . 

— (»*A  -  Ph) 


iXr 


2 

dX 


ilg-  P9)i^h  -  Ph) 

2ir*  ^ 


g,h=\  9^ 

The  integral  on  the  right-hwd  side  of  (3.53)  is 


53  P^P*  J  ^9  ®i“  c‘^^'‘~*^dA. 

r,«=— OO 


(3.60) 


17 


_  |gtA(fl+fc+r-»)  _  gtA(j-fc+r-*)  _  g»A(-a+A+r-»)  gtA(-s-A+r-»)j 

Since  =  0  unless  fc  =  0,  we  find  that  (3.53)  is 

2^  Z  /L^  KPrPr^rg-h  PrPr+g+h  PtPt-ij-u  +  Prpr-g+h) 


(3.61) 


=  4^  i:  <’•»  f  (p,^.  -  p,-.)(Pr^,  -  P,-,). 


Thus  the  Cramer-von  Mises  statistic  can  be  written 


(3.62) 


8>r‘G3(T)  S 


^  (**3  Pg){Pr+g  ~~  Pr-g) 


In  the  special  case  of  /o(A)  =  l/(2jr)  ( that  is  pi  =  pa  =  •  •  *  =  0)  the  Cramer-von 
Mises  criterion  (except  in  the  part  of  the  sura  not  depending  in  the  sample)  is 


(3.63) 


T  T-1  J2 

__  V'  _£ 


In  this  case  any  finite  set  of  y/Tvg  has  a  limiting  normal  distribution  in  which  the 
variables  are  independent  standard  normal  variables.  On  this  basis  the  limiting  distri¬ 
bution  of  (3.63)  is  consistent  with  the  limiting  distribution  of  the  Cramer-von  Mises 
statistic  as  indicated  in  Section  3.2.  It  may  be  of  interest  to  compare  (3.63)  with  the 
Box-Pierce  statistic  T  H^i  r*  in  some  fixed  K  <T. 


3.4.  The  Kolmogorov-Smirnov  Criterion 

To  test  Ho  :  F{\)  =  /o(A)  on  a  large-sample  basis  we  want  to  find  a  constant  c 
such  that 


(3.64) 


Pr  I  "fWr  -  ‘^1 

i  2^xG(7r)  J 


1  —  a 


\2y/irG{x)o<u<i  J 

for  a  specified  a  (0  <  a  <  1)  as  T  -♦  oo.  We  want  to  evaluate 


(3.65) 


Pr  <  sup  |B(u)  -f  go(u)-^|  <  c  i  • 

J 
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First  we  derive  some  inequalities.  Let 


(3.66) 

Then 

(3.67) 

Thus 


d=  sup  |9o(u)|. 

0<ti<l 


sup  |fi(u)  +  9o(«)^|  <  sup  |fi(u)|  +  \X\d. 

0<%<1  0<ii<l 


(3.68)  Pr|  sup  |5(u)|  +  |^|d<cl  <  Pr(  sup  |5(u)  +  X^u)!  <  4 
i,0<u<l  J  lo<»</  J 

<  Pr| 


sup  |S(u)|<4- 


The  right-hand  inequality  follows  from  (2.34). 
The  distribution  of  sup(,<„<i  |^(«)|  is 


sup  |B(u)|  +  dlA"!  <  tel  =  Pr  {y  -1-  Z  <  u;} 
(0<ti<l  J 


(3.69)  Pr  (  sup  lB(u)l  <4  =  1  +  2y)(“l)^ 

Let  V  =  8upo<„<i  |fi(ti)|  and  Z  =  |.  The  density  of  Z  is  [2/(d\/2x)]e~**^^^'**\  z  > 

0.  For  te  >  0 

(3.70)  Pr  I 

=  r  Pr  { V  <  tn  -  z\Z  =  z} 

Jo  dy/^ 

U  yrrw  [  Uvr+w; 

Values  of  this  distribution  are  given  in  Table  1.  If  d  is  small,  (3.70)  is  an  approximation 
to  (3.65). 

If  (3.65)  is  1  —  a  and  a  is  small,  then  a  is  approximately  2  times 

(3.71)  Pr  I  sup  [5(u)  -I-  A'go(«)]  >  cl . 

l0<ti<l  J 
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Suppose  0  <  9o(«)  <  d.  Then  for  X  <  0 

(3.72)  sup  B{u)  <  sup  [B(u)  +  <  sup  B{u)  +  Xd, 

0<u<l  0<“<1  0<“<1 

and  for  A"  <  0 


(3.73) 

Then 

(3.74) 


sup  B{u)  +  Xd  <  sup  [B(u)  +  Ag(u)]  <  sup  B{u) 


0<u<l 


0<u<l 


0<u<l 


^Pr  I  sup  B{u)  >  cl  +  ^Pr  I  sup  B{u)  —  |A|d  >  cl 
2  (o<ii<i  J  2  lo<u<i  J 

<  Pr[ 

<  ipr  I  sup  B{u)  +  |A|d  >  c  I  +  ^Pr  |  sup  B{u)  >  cl . 

2  lo<ti<i  J  2  lo<u<i  J 


sup  [5(u)  +  A9o(«)]  >  cl 
(0<t«<l  J 


Let  y  =  8upo<„<i  B(u)  and  Z  =  d|A|.  Since  Pr{y  <  y}  =  1  -•  >  0,  the 

density  of  Y  is  .  Thus  for  in  >  0 

(3.75)  Pr  I  sup  B{u)  +  d|A|  <  ml 
(0<ti<l  J 

=  Pr{y  +  Z<m} 

2 


=  2$ 
Similarly 


V'4d*  +  l' 


K 


m 


dy/4<P  + 


l)  \V4<P  +  l)^ 


(3.76)  Pr  I  sup  B{u)  -  d\X\  <  ml 

(0<ti<l  J 

f  (j)  -  » (jTsfe) '  ^  ^  0’ 


=  < 


1  2  ^  (  -Adu,  \ 

^  ^  W4ib+i/  ’ 


m  >  0. 


Values  of  (3.75)  and  (3.76)  are  given  in  Tables  2  and  3,  respectively. 
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The  extremes  of  qo{u)  can  be  foimd  by  setting  to  0  the  derivative 


(3.77) 


that  is,  at  /o(A)  =  0  or 
(3.78) 


/o(A)  =  Go{ir)  —  ^  Pk' 


We  now  consider  the  supremum  of  |9o(u)|  over  0  <  u  <  1  and  all  /o(-)>  the 

supremum  of  1((?(A)/G(x)]  -  /’(A)|.  Since  G(A)/G(7r)  and  F{X)  are  monotonically 
nondecreasing  in  (0,  tt]  with  G(0)/G(t)  =  F(0)  =  0  and  G{ir)/G{v)  =  F{ir)  =  1, 


(3.79) 


sup  |9(u)|  <  1. 
o<“<i.  /(•) 


We  shall  now  find  an  /(■)  such  that  the  upper  bound  of  1  is  approached.  Consider 


(3.80) 


^  '  \  d,  t/<A<x, 


for  some  c,d,  and  i/(0  <  v  <  v).  Then 


(3.81) 

implies 

(3.82) 

Then  as  u 

(3.83) 


G(x) 


-F{u) 


!r/(A)dA  = 

Jo 


1  —  2i/c 


2jrc  +  2x0  —  1  —  4x*c 
^  1  —  4xc  +  4x*c*  ^ 

=  2xc. 


Hence  as  c  —» l/(2x), 
(3.84) 


0<A<)r 
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The  probability  (3.65)  is  a  boundary  value  problem  for  the  process  B{u)  +  Xq{u). 
It  is 

(3.85)  Pr{— c  <  B{u)  +  Xq(u)  <  c,  Vu,  0  <  u  <  1). 

Note  that  the  sample  paths  2ire  continuous  with  probability  1.  Let 

(3.86)  W^(0  =  (1+0jb(y^)>0<<<oo- 

Then  W{t)  is  the  Wiener-Brownian  motion  process  with  £W{t)  =  0  and  5W(t)W(s)  = 
min(t,s);  sample  paths  are  continuous  with  probability  1.  The  probability  (3.85)  is 

(3.87)  Pr  |-c(l  -!-<)<  +  X{1  t)q  <  c(l  -I-  0  <  t  <  oo}  . 

Dadilhaus  (1985)  has  also  given  this  result. 

Durbin  (1985)  has  studied  the  first  passage  density  of  a  continuous  Gaussian 
process  to  a  general  boundary.  The  probability  (3.71)  is  then  the  integral  of  this 
density  from  0  to  1.  An  approximation  to  this  probability  is 


(3.88) 


_c_  ru  -  f  -f  q'jtHt)  .c?n2m,t)]j. 


Where  k(t,t)  =  t  —  B  +  q^{t).  In  practice  (3.88)  could  be  evaluated  by  numericaJ 
integration.  Durbin  also  gives  an  exact  expression  as  well  as  two  other  approximations 
to  the  first  passage  density.  As  an  example  he  applies  his  formulas  to  Pr{B(u)  >  c) 
for  several  values  of  c.  For  c  yielding  an  exact  probability  of  .1  this  approximation 
has  an  error  of  only  .0021;  for  larger  values  of  c  (smadler  values  of  q)  the  error  is 
proportionally  smaller. 


4.  Confidence  Region  for  the  Spectral  Distribu¬ 
tion  Function 

An  asymptotic  confidence  region  with  confidence  coefficient  1— a  for  an  unknown 
spectral  distribution  consists  of  all  monotonic  functions  F(-)  [F(0)  =  0,  F(l)  =  1] 
such  that 

(4.1)  \/f|FT(A)-F(A)|  <c  VA€[0,7r], 
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where  c  is  chosen  so  that  (3.59)  is  1  —  a  and  go(«)  refers  to  the  unknown  distribution. 
Since  c  depends  on  qo{u),  we  need  a  consistent  estimator  of  9o(u). 

From  the  fact  that  \/T[Ft{X)  —  F’(A))  has  a  limiting  normal  distribution  it  follows 
that 

(4.2)  Ft{X)  F(A). 

Let  /(A)  be  a  consistent  estimator  of  /(A)  in  the  sense  that 

(4.3)  sup  |/r(A)  - /(A)U0. 

For  such  an  estimator  the  class  of  admissible  /(A)  must  be  limited.  Define 

(4.4)  Gr(A)=2/"^(i/)dt., 

JO 

(4.5)  ^(«)  =  u  -  A’{^r*l^T(’r)«]}. 

Then  qT{^)  is  a  consistent  estimator  of  go(«)«  If  cx  is  the  value  of  c  for  which  (3.59) 
holds  with  ?o(«)  replaced  by  9t(«)i  then  cy  c. 

The  inequality  (4.1)  can  be  written 

(4.6)  Ft{X)  -^<  F{X)  <  Ft{X)  +  ^  VA  €  [0,  tt]. 

Another  problem  of  interest  is  testing  that  the  spectral  densities  of  two  indepen* 

A 

dent  processes  are  the  same;  the  mull  hypothesis  is  Fi(A)  =  F2(A).  Suppose  Ft, (A) 
and  Ftj(X)  are  the  correspending  two  empirical  processes.  Under  the  null  hypothesis. 

converges  weakly  to  the  Gaussian  process  with  covariamce  function  (2.19),  where  F(X) 
and  G(A)  refer  to  the  common  spectral  distribution  and  the  integral  of  the  common 
spectral  density  squared,  respectively. 

The  Kolmogorov-Smirinov  criterion 

(4.8)  sup  |A’,(A)  -  Fr,A)| 

0<A<ir 
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can  be  uses  to  test  the  null  hypothesis.  If  and  /tj(A)  are  consistiiut  estimators 

of  the  common  spectral  density  (in  the  sense  of  (4.3)],  then 

(4-9)  +  + 

can  be  used  to  estimate  (j(A)  and  q(u). 


5.  Examples 

5.1.  Moving  Average  of  Order  1 


(5.1) 

where  Uj  are  iid  A^(0,<r).  Then 


yt  =  Ut  +  QfU|_i, 


P\=P  = 


l  +  a^’ 


/(A)  =  — (1  +2p  cos  A), 


1 

F(A)  —  —  I  (1  +  2p  cos  i/)  di/ 
X  Jo 


=  — (A  +  2psinA), 


1 

=  2^  (1  +  4p  cos  1/  +  4p*  cos’  v)dv 

~  ^  ^  ^  ^  2p’(A  +  i  sin2A)j 

=  ^  [(1  +  2p’)A  +  4p  sin  A)  +  p’  sin2Aj  , 


G(t)  = 


1  +  2p^ 
27r  ’ 


G(A)  (1  +  2p’)A  +  4p  sin  A  +  p*  sin2A 
G(t)  "  T(r+2p*)  • 
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The  difference  is 

G(A)  2^smA(l -2^2 +pcosA) 

GW  -  =  ;(iTv) - ■ 

This  is  nonnegative  for  0  <  />  <  A  and  0  <  A  <  t  and  nonpositive  for  —  A  <  p  <  0. 

The  mMimum  of  |9(n)l  occurs  at  /(A)  =  G(7r)  (by  setting  the  derivative  of 
[G(A)/G(ir)]  —  F{\)  equaJ  to  0),  that  is, 

(5.9)  1+2/)  cos  A  =  1  +  2/)*; 


that  is,  cos  Ao  =  /)  or  Ao  =  cos  ^  p.  Then 


(5.10) 


G(Ao) 


-  Fi^u) 


1/4/)  sin  Ao 

=  tI,  t 


+  sin  2Ao 


T  V  1  +  2/)2 
2  cosAo  sin^Ao 
)r(l  +  2  cos*  Ao) 


—  2p  sin  Ao 


The  maximum  of  \q{u)\  is  at  a  zero  of 

/cii\  r/i  \1  2  sin’Ao(l -6  cos*Ao -4  cos^Ao) 

^  ^  dAo  [  G(ir)  ~  T  ■  (1  +  2  cos*  Ao)* 


The  zeros  of  (5.11)  are  Aq  =  0,  tt,  and 


(5.12) 


cos*  An  = 


-3±\/l3 


(5.13) 

The  extremum  of  (5.10)  is 


(5.14) 


pI  =  cos*  Ao  =  .15138. 


2v/l5l4(.8486)^ 
)r(l  +2-.1514) 


=  .1483  . 


The  vadue  of  .1483  is  considerably  less  than  1. 
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5.2.  Autoregression  of  Order  1 

Consider  the  process 


(5.15) 


Vt  =  PVt-i  +  “t. 


where  the  Ut’s  axe  uncorrelated  with  mean  Suf  =  0  eind  variance  £u]  =  The 
conventional  (imnormalized)  spectral  density  is 


(5.16) 

The  variance  of  yt  is 

(5.17) 


25r  |1  —  27r(l  +  —  2p  cos  A) 


Syt^  = 


V''-*  ■  /  ''HI  —  1  o  • 

1 

The  normalized  spectral  density  and  its  square  are 


(5.18) 


/(A)  = 


2ff(l  +  p*  —  2/)  cos  A) 


f\>)  = 


^  47r2(l  +  p2  -  2p  cos  A)2 

^  (1-p^)^ 

47r^  1(1  —  pe’'^)^|* 

^  (1  - 
47r^  |1  —  2pe’^  + 

This  is  (1  —  p^)^/(27r)  times  the  spectral  density  of  xt  satisfying 


(5.20) 


Xt  -  2pXt-l  +  P  Xt-2  =  Vt, 


where5ut  =  0,  =  1, 2uid  £t;tv»  =  0,  t^s.  Thevarianceofxtis(l+p^)/(l— p^)^. 


Thus 


(5.21) 


G{ir)  =  2rf{X)dX 
Jo 

1  1-l-p" 

27r  1  —  p2  ■ 
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The  equation  G{ir)  =  /(A)  is 


(5.22) 

1  +  P^  1-p^ 

1  —  p^  1  +  p^  —  2p  cos  A 

or 

1  +  p  2p  cos  A  =  ,  2 

1  +  P'' 

(5.23) 

or 

i  2p 

cosA„=i^^. 

(5.24) 

For  example,  cos  Ao  =  V^/2  =  .707  for  p  =  y/2—1  =  .414,  that  is,  Ao  =  ir/4;  cos  Aq  =  0 
for  p  =  0,  that  is,  Ao  =  ^;cosAo  =  1  for  p  =  1,  that  is,  Aq  =  0.  The  normalized 
spectral  distribution  of  {yt}  is 


(5.25)  F{X)  = 


(!-(>’)  /■» 


/ 


dX 


X  Jo  1  +  —  2p  cos  A 

2(1  -  e-)  '■ 


.-1 


,«U1 

[  1  +/>^ 

2  1 
=  —tan  ^ 

1  +  p  ^  A 

1  tan  „ 

1  -p  2 

The  integral  of  the  square  of  the  density  is 

(5  *'6)  C{  \)  — 

dX 

Jo  (1+  p2  - 

2p  cosA)2 

(1  -  P^? 

r  2p 

sin  A 

2x2 

L(l-p2)2  l+p2 

—  2p  cos  A 

+ 

„  •  .  tan  *  ( 

''1  +  p 
- - tan  ■ 

tan 


sin  A 


1  +  p*  —  2p  cos  A 

/(A)  + 


2p  sin  A  ,  l+p* 


Then 

(5.27) 


x(l  -p2) 

G(A) 


G'(x) 


-F(A)  = 


27r(l-p2) 
2jr(l  -  p’) 


^)i 

F{X). 


p  sin  A 


1  +  p*  1x^(1  +  p^  —  2p  cos  A) 
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(t^ 

sin  A 


P.  A 
-  tan  —  , . 
P  2  1 


x2(l  -  p2) 

2 

- tan 

ir 

Ml  -  p'‘) _ 

ir(l  +  p^)  1  +  —  2p  cos  A 

1  + 


•  sin  A /(A). 


Note  that  ^(u)  >  0  for  p  >  0  and  q{u)  <  0  for  p  <  0.  For  cos  Aq  = 


GW  ^(l  +  p2)  '(l  +  p2)-(l_p2)2 

2p 

X(1  +  p2) 

=  —  COS  Ao. 

TC 

The  difference  (5.28)  approaches  I/jt  =  .3184  as  Ao  -♦  0  (that  is,  as  p  — »1)  and 
approaches  — l/ir  as  Ao  — »  jr  (that  is,  as  p  — ♦  —1).  This  is  the  maximum  of  |9(«)|. 
Note  that  .3184  is  less  than  the  maximum  of  1  over  processes  but  greater  them  the 
maximum  of  .1486  for  moving  average  processes  of  order  1. 


5.3.  Another  Example 

Suppose  /(A)  =  (a  +  l)|A|“/(2x“'*’^),  a  >  0.  Then 


(5.29) 


F(A)  = 


Aa+l 

irO+l 


0  <  A  <  TT, 


(5.30) 

(5.31) 

(5.32) 


G(A)  = 


(g  +  1)^  2o+i 
2(2q  +  l)7r2»+2 


0  <  A  <  jr. 


G{r) 


2(2Q  +  l)7r’ 


G(A)  A2*+i 
■  G(jr)  ~  7r2“+»’ 


0  <  A  <  TT, 
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(5.33)  A  =  0  <  u  <  1, 

(5.34)  q{u)  =  tx  - 

=  ^^(«+l)/(2«+l)  |'„a/(2o,+l)  _  J 


(5.35)  ^5(u)  =  1  - 

The  maximum  of  |9(u)|  in  [0,1]  is  at 


.^±i_  -a/(2a+l) 
2a +  1 


(5.36) 


„a/(2a+l)  _  “ 

“  “2a  +  l’ 


aad  the  maximum  is  the  absolute  value  of 


(5.37) 


\^x 

X  —X 


x-*(l  -  x), 


where  x  =  2  +  A  (>  2).  The  derivative  of  (5.37)  with  respect  to  x  is 
(5.38)  —  x“*[(l  —  x)logx  +  2  —  x], 


which  is  positive  for  x  >  2.  Thus  (5.37)  is  an  increasing  function  of  x  and  a  decreasing 
function  of  a.  As  a  — » <»,  the  limit  of  (5.37)  is  -.25. 


6.  Conditions  for  Weak  Convergence 

Grenander  and  Rosenblatt  (1953)  showed  that  if  7j  =  0{j~^)  for  some  ^  > 
3/2  and  if  the  «t’s  are  independently  identically  distributed  with  Exit  =  0,  £u]  = 
<T*,  Evl*  =  K4  +  3<r^,  and  fuf  <  oo,  then 

(6.1)  v^T  m«  \Ht{X)  -  H(X)\  4  mj«  |C7(A)|, 
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where  H{X)  =  <t(0)F(A),  HriX)  =  coFt(A),  and  U{X)  is  a  Gaussian  process  with 
EU{X)  =  0  and  covariance  function 

(6.2)  SU{X)U{v)  =  47rG[min(A,  i/)]  +  ^H{X)H{v). 

A  numuber  of  authors  have  shown  that 

(6.3)  \/T[Ht{X)  -  H{X)]  A  U{X) 


imder  various  alternative  sets  of  conditions.  Ibragimov  and  Tovstik  (1964)  demon¬ 
strated  the  limiting  covariance  function  (6.2)  under  the  conditions  ESo  7?  <  oo,  G{ir)  < 
oo,  ut  independently  identically  distributed,  and  Su*  <  oo.  Shaman  (1971)  also 
proved  this  result.  See  Dahlhaus  (1985)  for  a  review  of  the  literature. 

We  can  write 


(6.4) 


Ft{X)-F{X) 


HHX)  HjX) 

Co  <t{0) 

HriX)  -  H(X)  -[co-  <T{0)]HiX)/ai0) 
Co 

Ht{X)  -  H{X)  -  [^r(^r)  -  H{t)]F{X) 
Co 


If  Co  o'(O)  as  r  — »  oo,  then  y/T[FT{X)  —  F(A)]  converges  weakly  to  Z(A)  = 
U{X)  —  U{ir)f{X),  which  is  Gaussian  with  expected  value  0  and  covariance  function 


(6.5)  £:Z(A)Z(i/)  =  £[UiX)  -  U{ir)F{X)][U{X)  -  U{ir)F{u)] 

=  4x{G[min(A,  */)  -  f{X)G{u)  -  G(A)F(»/)  G(7r)F(A)F(i^)}, 

which  is  exactly  (2.19). 

Note  that  there  is  no  term  in  (6.5)  involving  k^.  This  fact  suggests  that  the 
condition  ZuJ  <  oo  may  be  unnecessary.  Anderson  (1991b)  has  shown  that  y/T[FT  — 
F(A)]  Z(A)  if  {yt}  satisfies  (2.10)  with  (2.12)  holding, 

(6.6)  I3v^|7»I<oo> 

*=o 

and  the  {tij  being  independently  identically  distributed  with  Sut  =  0  and  Eu}  = 
This  result  is  generalized  to  the  following  theorem: 
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Theorem.  Suppose  {j/t}  is  defined  by  (2.10),  where  {7,}  satisfies  (2.12) 

(6-7)  53v/sj7,l  <  C50. 

*=o 

Let  Tx  be  the  <T-algebra  generated  by  and  let  I  {A)  =  1  if  A  occurs  and 

/(A)  =  0  otherwise.  Suppose  {uj}  satisfies 


(6.8) 


^(«t|^t-i)  =  0  a.e., 


(6.9) 

(6.10) 

where  is  a  constant, 


S{u]\:Ft-i)  =  a]  a.e., 
T 


rp 


tel 


(6.11) 


sup  €[u]l{xt]  >  a)|.Ft_i]  A  0 


as  a  — ♦  00, 

(6.12) 


^  Sr, <7*,  r,  s  =  1 , 2,  •  •  •  , 


tel 


where  Srr  =  1  and  Sr,  =  0,  r  ^  a, 


(6.13)  eu]<K,  t  =  ...,-l,0,l,..-, 

and 

(6.15)  €u^ut-,ut.,  =  0,  r,s  =  l,2,*--. 

Then 

(6.16)  v^[Fj.(A)-F(A)]  AZ(A). 
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Table  1 


Pr 


sup 

0<U<1 


|5{u;l  + 


w  \  d 

0 

0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

0.8 

1.0 

0.4 

0.0028 

0.0005 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.5 

0.0361 

0.0113 

0.0059 

0.0037 

0.0025 

0.0019 

0.0015 

0.0012 

0.0010 

0.0008 

0.6 

0.1357 

0.0625 

0.0359 

0.0245 

0.0184 

0.0146 

0.0121 

0.0104 

0.0090 

0.0072 

0.7 

0.2888 

0.1730 

0.1088 

0.0768 

0.0588 

0.0474 

0.0396 

0.0340 

0.0298 

0.0238 

0.8 

0.4559 

0.3251 

0.2249 

0.1647 

0.1281 

0.1042 

0.0876 

0.0755 

0.0663 

0.0532 

0.9 

0.6073 

0.4856 

0.3662 

0.2800 

0.2224 

0.1828 

0.1547 

0.1339 

0.1178 

0.0950 

1.0 

0.7300 

0.6294 

0.5113 

0.4083 

0.3319 

0.2770 

0.2361 

0.2053 

0.1813 

0.1467 

1.1 

0.8223 

0.7455 

0.6428 

0.5358 

0.4474 

0.3783 

0.3262 

0.2851 

0.2529 

0.2056 

1.2 

0.8878 

0.8325 

0.7504 

0.6514 

0.5588 

0.4806 

0.4188 

0.3691 

0.3287 

0.2689 

1.3 

0.9319 

0.8943 

0.8321 

0.7487 

0.6597 

0.5776 

0.5094 

0.4526 

0.4057 

0.3340 

1.4 

0.9603 

0.9359 

0.8923 

0.8264 

0.7460 

0.6654 

0.5944 

0.5328 

0.4802 

0.3994 

1.5 

0.9778 

0.9626 

0.9334 

0.8839 

0.8157 

0.7423 

0.6713 

0.6075 

0.5514 

0.4627 

1.6 

0.9880 

0.9790 

0.9603 

0.9245 

0.8706 

0.8053 

0.7388 

0.6754 

0.6182 

0.5233 

1.7 

0.9938 

0.9887 

0.9772 

0.9530 

0,9127 

0.8567 

0.7955 

0.7347 

0.6777 

0.5804 

1.8 

0.9969 

0.9941 

0.9873 

0.9717 

0.9421 

0.8970 

0.8433 

0.7875 

0.7323 

0.6329 

1.9 

0.9985 

0.9971 

0.9932 

0.9835 

0.9621 

0.9275 

0.8830 

0.8319 

0.7797 

0.6824 

2.0 

0.9993 

0.9986 

0.9965 

0.9906 

0.9764 

0.9512 

0.9129 

0.8680 

0.8208 

0.7260 

2.1 

0.9997 

1.0000 

0.9983 

0.9948 

0.9856 

0.9672 

0.9366 

0.8983 

0.8551 

0.7667 

2.2 

0.9999 

1.0000 

1.0000 

0.9973 

0.9915 

0.9777 

0.9556 

0.9237 

0.8846 

0.8015 

2.3 

0.9999 

1.0000 

1.0000 

0.9986 

0.9951 

0.9858 

0.9683 

0.9431 

0.9092 

0.8338 

2.4 

1.0000 

1.0000 

1.0000 

1.0000 

0.9972 

0.9911 

0.9788 

0.9572 

0.9302 

0.8614 

2.5 

1.0000 

1.0000 

1.0000 

1.0000 

0.9985 

0.9945 

0.9848 

0.9697 

0.9456 

0.8853 

3.0 

1.0000 

1,0000 

1.0000 

1.0000 

1.0000 

1.0000 

0.9984 

0.9947 

0.9883 

0.9606 

3.5 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

0.9978 

0.9882 

4.0 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

0.9971 

Values  of  w  for  which  Pr  \  sup  |5(u)|  +  d  |X|  <  w 

\0<u<l 


w  \  d 

0 

0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

00 

o 

1.0 

0.001 

0.3742 

0.4171 

0.4416 

0.4616 

0.4742 

0.4829 

0.4894 

0.4946 

0.4991 

0.5067 

0.01 

0.4410 

0.4947 

0.5238 

0.5452 

0.5620 

0.5758 

0.5874 

0.5977 

0.6069 

0.6232 

0.05 

0.5196 

0.5834 

0.6253 

0.6572 

0.6833 

0.7058 

0.7259 

0.7439 

0.7606 

0.7908 

0.10 

0.5712 

0.6402 

0.6906 

0.7305 

0.7642 

0.7939 

0.8206 

0.8452 

0.8682 

0.9106 

0.25 

0.6765 

0.7527 

0.8188 

0.8756 

0.9262 

0.9727 

1.0159 

1.0569 

1.0961 

1.1706 

0.50 

0.8276 

0.9094 

0.9921 

1.0712 

1.1465 

1.2190 

1.2894 

1.3589 

1.4265 

1.5616 

0.75 

1.0192 

1.1045 

1.1995 

1.3015 

1.4050 

1.5122 

1.6183 

1.7265 

1.8358 

2.0583 

0.90 

1.2238 

1.3114 

1.4158 

1.5349 

1.6657 

1.8086 

1.9552 

2.1039 

2.2603 

2.5746 

0.95 

1,3581 

1.4470 

1.5562 

1.6871 

1.8340 

1.9936 

2.1651 

2.3488 

2.5247 

2.8967 

0.99 

1.6276 

1.7192 

1.8385 

1.9890 

2.1696 

2.3757 

2.6007 

2.8387 

3.0469 

3.5591 

0.999 

1.9495 

2.0443 

2.1762 

2.3516 

2.5687 

2.8192 

3.0942 

3.3866 

3.6906 

4.3193 
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Table  2 


Pr 


I  sup 


+  \<i\  \X\ 


w  \  d 

0 

0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

0.8 

1.0 

0 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.1 

0.0198 

0.0050 

0.0026 

0.0018 

0.0013 

0.0011 

0.0009 

0.0008 

0.0007 

0.0005 

0.2 

0.0769 

0.0350 

0.0198 

0.0135 

0.0103 

0.0082 

0.0069 

0.0059 

0.0052 

0.0041 

0.3 

0.1647 

0.0980 

0.0613 

0.0432 

0.0331 

0.0267 

0.0224 

0.0193 

0.0169 

0.0136 

0.4 

0.2739 

0.1893 

0.1299 

0.0948 

0.0737 

0.0600 

0.0505 

0.0436 

0.0383 

0.0308 

0.5 

0.3935 

0.2994 

0.2217 

0.1682 

0.1331 

0.1094 

0.0926 

0.0801 

0.0705 

0.0568 

0.6 

0.5132 

0.4180 

0.3291 

0.2592 

0.2094 

0.1741 

0.1483 

0.1288 

0.1137 

0.0920 

0.7 

0.6247 

0.5352 

0.4428 

0.3616 

0.2985 

0.2513 

0.2157 

0.1883 

0.1669 

0.1355 

0.8 

0.7220 

0.6431 

0.5541 

0.4679 

0.3949 

0.3370 

0.2919 

0.2564 

0.2280 

0.1861 

0.9 

0.8021 

0.7365 

0.6563 

0.5712 

0.4928 

0.4268 

0.3732 

0.3300 

0.2949 

0.2420 

1.0 

0.8647 

0.8130 

0.7446 

0.6657 

0.5868 

0.5161 

0.4561 

0.4062 

0.3649 

0.3015 

1.1 

0.9111 

0.8723 

0.8172 

0.7479 

0.6729 

0.6010 

0.5371 

0.4822 

0.4356 

0.3626 

1.2 

0.9439 

0.9162 

0.8738 

0.8160 

0.7482 

0.6786 

0.6134 

0.5554 

0.5049 

0.4238 

1.3 

0.9660 

0.9472 

0.9161 

0.8701 

0.8115 

0.7469 

0.6831 

0.6240 

0.5711 

0.4836 

1.4 

0.9802 

0.9679 

0.9462 

0.9111 

0.8627 

0.8052 

0.7450 

0.6867 

0.6329 

0.5411 

1.5 

0.9889 

0.9813 

0.9667 

0.9411 

0.9026 

0.8533 

0.7983 

0.7426 

0.6894 

0.5954 

1.6 

0.9940 

0.9895 

0.9802 

0.9622 

0.9327 

0.8919 

0.8433 

0.7915 

0.7401 

0.6460 

1.7 

0.9969 

0.9943 

0.9886 

0.9765 

0.9548 

0.9220 

0.8803 

0.8334 

0.7850 

0.6926 

1.8 

0.9985 

0.9971 

0.9937 

0.9858 

0.9703 

0.9449 

0.9101 

0.8687 

0.8240 

0.7351 

1.9 

0.9993 

0.9985 

0.9966 

0.9917 

0.9810 

0.9619 

0.9336 

0.8979 

0.8576 

0.7733 

2.0 

0.9997 

0.9993 

0.9983 

0.9953 

0.9882 

0.9742 

0.9517 

0.9216 

0.8860 

0.8075 

2.1 

0.9999 

0.9997 

0.9991 

0.9974 

0.9928 

0.9828 

0.9655 

0.9407 

0.9097 

0.8377 

2.2 

0.9999 

0.9999 

0.9996 

0.9986 

0.9957 

0.9888 

0.9758 

0.9557 

0.9292 

0.8641 

2.3 

1.0000 

0.9999 

0.9998 

0.9993 

0.9975 

0.9929 

0.9832 

0.9673 

0.9451 

0.8871 

2.4 

1.0000 

1.0000 

0.9999 

0.9996 

0.9986 

0.9955 

0.9886 

0.9762 

0.9579 

0.9069 

2.5 

1.0000 

1.0000 

1.0000 

0.9998 

0.9992 

0.9973 

0.9924 

0.9829 

0.9681 

0.9238 

3.0 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

0.9998 

0.9992 

0.9973 

0.9932 

0.9751 

3.5 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

0.9999 

0.9997 

0.9989 

0.9933 

4.0 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

0.9999 

0.9985 
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Table  3 


Pr<  sup  |S(u)|  —  |d|  |Xi  <  u; 

l^O<u<l 


w  \  d 

0 

0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

0.8 

1.0 

-4.0 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

-3.0 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0005 

-2.0 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0001 

0.0005 

0.0020 

0.0120 

-1.5 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0002 

0.0013 

0.0051 

0.0128 

0.0423 

-1.25 

0.0000 

0.0000 

0.0000 

0.0000 

0.0001 

0.0010 

0.0048 

0.0136 

0.0284 

0.0734 

-1.0 

0.0000 

0.0000 

0.0000 

0.0000 

0.0007 

0.0046 

0.0149 

0.0330 

0.0579 

0.1210 

-0.9 

0.0000 

0.0000 

0.0000 

0.0001 

0.0015 

0.0080 

0.0226 

0.0456 

0.0753 

0.1458 

-0.8 

0.0000 

0.0000 

0.0000 

0.0002 

0.0032 

0.0134 

0.0334 

0.0620 

0.0968 

0.1743 

-0.7 

0.0000 

0.0000 

0.0000 

0.0007 

0.0063 

0.0219 

0.0484 

0.0831 

0.1229 

0.2067 

-0.6 

0.0000 

0.0000 

0.0000 

0.0019 

0.0121 

0.0347 

0.0685 

0.1096 

0.1541 

0.2432 

-0.5 

0.0000 

0.0000 

0.0002 

0.0048 

0.0219 

0.0533 

0.0950 

0.1422 

0.1910 

0.2840 

-0.4 

0.0000 

0.0000 

0.0009 

0.0110 

0.0379 

0.0793 

0.1290 

0.1818 

0.2339 

0.3292 

-0.3 

0.0000 

0.0000 

0.0035 

0.0235 

0.0627 

0.1146 

0.1717 

0.2289 

0.2832 

0.3788 

-0.2 

0.0000 

0.0002 

0.0113 

0.0461 

0.0993 

0.1611 

0.2240 

0.2840 

0.1390 

0.4327 

-0.1 

0.0000 

0.0030 

0.0307 

0.0840 

0.1506 

0.2201 

0.2866 

0.3473 

0.4013 

0.4908 

0 

0.0000 

0.0194 

0.0715 

0.1425 

0.2191 

0.2929 

0.3598 

0.4188 

0.4700 

0.5528 

0.1 

0.0198 

0.0682 

0.1414 

0.2243 

0.3053 

0.3787 

0.4426 

0.4973 

0.5439 

0.6178 

0.2 

0.0769 

0.1488 

0.2357 

0.3233 

0.4031 

0.4719 

0.5300 

0.5786 

0.6194 

0.6829 

0.3 

0.1647 

0.2525 

0.3452 

0.4309 

0.5048 

0.5661 

0.6165 

0.6580 

0.6922 

0.7448 

0.4 

0.2739 

0.3690 

0.4600 

0.5387 

0.6035 

0.6556 

0.6974 

0.7313 

0.7590 

0.8010 

0.5 

0.3935 

0.4880 

0.5714 

0.6397 

0.6936 

0.7359 

0.7693 

0.7959 

0.8174 

0.8498 

0.6 

0.5132 

0.6006 

0.6727 

0.7288 

0.7717 

0.8046 

0.8300 

0.8501 

0.8663 

0.8904 

0.7 

0.6247 

0.7005 

0.7594 

0.8034 

0.8360 

0.8604 

0.8791 

0.8937 

0.9054 

0.9226 

0.8  • 

■  0.7220 

0.7841 

0.8299 

0.8627 

0.8864 

0.9038 

0.9170 

0.9272 

0.9353 

0.9472 

0.9 

0.8021 

0.8505 

0.8842 

0.9077 

0.9242 

0.9361 

0.9451 

0.9519 

0.9573 

0.9653 

1.0 

0.8647 

0.9004 

0.9242 

0.9402 

0.9512 

0.9591 

0.9649 

0.9693 

0.9728 

0.9779 

1.25 

0.9561 

0.9697 

0.9778 

0.9829 

0.9863 

0.9886 

0.?903 

0.0915 

C.9925 

0.9939 

1.5 

0.9889 

0.9928 

0.9949 

0.9962 

0.9969 

0.9975 

0.9979 

0.9981 

0.9984 

0.9987 

2.0 

0.9997 

0.9998 

0.9999 

0.9999 

0.9999 

0.9999 

0.9999 

1.0000 

1.0000 

1.0000 

2.5 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 
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